Ars Informatica -- Ars Electronica: Improving Sonification Aesthetics

In this paper we discuss æsthetic issues of sonifications. We posit that many sonifications have suffered from poor acoustic ecology which makes listening more difficult, thereby resulting in poorer data extraction and inference on the part of the listener. Lessons are drawn from the electro acoustic music community as we argue that it is not instructive to distinguish between sonifications and music/sound art. Edgar Var`ese defined music as organised sound and sonifications organise sound to reflect some aspect of the thing being sonified. Therefore, we propose that sonification designers can improve the communicative ability of their auditory displays by paying attention to the æsthetic issues that are well known to composers, orchestrators, sound designers & artists, and recording engineers

From Server to PDA: An HCI Perspective on Porting Wireless Roaming Business Applications

Advances in processor design, display technology, and lithium polymer batteries have led to a new generation of powerful, compact, and highly mobile devices. There is a range of different physical interfaces available, from the original Palm Pilots and Psion Organisers to the new generation of pocket PCs and personal digital assistants (PDA's). We focus on the stylus/touch-screen-based Compaq iPaq PDA. Combining a PDA with wireless communication technology has the potential for extending the application of computing in business. Many businesses already use handheld data recording devices. A drawback is the need to return the device to a computer to upload the information into the system, where it can be processed and made available to other applications. Using wireless devices this delay can be removed, providing a more accurate and up-to-date data repository. In order to see how a desktop to PDA migration might be carried out, a prototype interface to a mainstream accounting and stock control system was built to run on a Compaq iPaq 3850. Some of the problem areas of migrating server/desktop functionality to handheld devices, including wireless communication, device limitations, and security were demonstrated and explored with this interface. The informal feedback from the users will be fed into a redeveloped version of the system which will then be evaluated using a formal experiment The main lesson learnt was that providing desktop/server functionality on a mobile device requires more than copying a system's existing functionality and shrinking the interface to fit on a smaller screen. User feedback from a prototype system supported the idea that applications benefit from a redesign process when being ported to a mobile environment

The CAITLIN Auralization System: Hierarchical Leitmotif Design as a Clue to Program Comprehension

Early experiments have suggested that program auralization can convey information about program structure [8]. Languages like Pascal contain classes of construct that are similar in nature allowing hierarchical classification of their features. This taxonomy can be reflected in the design of musical signatures which are used within the CAITLIN program auralization system. Experiments using these hierarchical leitmotifs indicate whether or not their similarities can be put to good use in communicating information about program structure and state

Musical Program Auralisation: Empirical Studies

Program auralisation aims to communicate information about program state, data, and behaviour using audio. We have argued that music offers many advantages as a communication medium [1]. The CAITLIN system [4, 16, 17, 18] was constructed to provide auralisations within a formal structured musical framework. Pilot studies [4, 16] showed that programmers could infer program structure from auralisations alone. A study was conducted using twenty-two novice programmers to assess a) whether novices could understand the musical auralisations and b) whether the musical experience and knowledge of subjects affected their performance. The results show that novices could interpret the auralisations (with accuracy varying across different levels of abstraction) and that musical knowledge had no significant effect on performance. A second experiment was conducted with another twenty-two novice programmers to study the effects of musical program auralisation on debugging tasks. The experiment aimed to determine whether auralisations would lead to higher bug detection rates. The results indicate that, in certain circumstances, musical auralisations can be used to help locate bugs in programs and that musical skill does not affect the ability to make use of the auralisations. In addition, it the experiment showed that subjective workload increased when the musical auralisations were used

The Use of Audio in Minimal Access Surgery

In minimal access surgery (MAS) (also known as minimally invasive surgery), operations are carried out by making small incisions in the skin and inserting special apparatus into potential body cavities through those incisions. Laparoscopic MAS procedures are conducted in the patient’s abdomen. The aim of MAS is faster recovery, shorter hospitalisation and fewer major post-operative complications; all resulting in lower societal cost with better patient acceptability. The technique is markedly dependent on supporting technologies for vision, instrumentation, energy delivery, anaesthesia, and monitoring. However, in practice, much MAS continues to take longer and be associated with an undesirable frequency of unwanted minor (or occasionally major) mishaps. Many of these difficulties result precisely from the complexity and mal-adaptation of the additional technology and from lack of familiarity with it. A survey of South East England surgeons showed the two main stress factors on surgeons to be the technical difficulty of the procedure and time pressures placed on the surgeon by third parties. Many of the problems associated with MAS operations are linked to the control and monitoring of the equipment. This paper describes work begun to explore ergonomic enhancements to laparoscopic operating technology that could result in faster and safer laparoscopic operations, less surgeon stress and reduce dependence on ancillary staff. Auditory displays have been used to communicate complex information to users in a modality that is complementary to the visual channel. This paper proposes the development of a control and feedback system that will make use of auditory displays to improve the amount of information that can be communicated to the surgeon and his assistant without overloading the visual channel. Control of the system would be enhanced by the addition of voice input to allow the surgeon direct control

Sonification of Network Traffic Flow for Monitoring and Situational Awareness

Maintaining situational awareness of what is happening within a network is challenging, not least because the behaviour happens within computers and communications networks, but also because data traffic speeds and volumes are beyond human ability to process. Visualisation is widely used to present information about the dynamics of network traffic dynamics. Although it provides operators with an overall view and specific information about particular traffic or attacks on the network, it often fails to represent the events in an understandable way. Visualisations require visual attention and so are not well suited to continuous monitoring scenarios in which network administrators must carry out other tasks. Situational awareness is critical and essential for decision-making in the domain of computer network monitoring where it is vital to be able to identify and recognize network environment behaviours.Here we present SoNSTAR (Sonification of Networks for SiTuational AwaReness), a real-time sonification system to be used in the monitoring of computer networks to support the situational awareness of network administrators. SoNSTAR provides an auditory representation of all the TCP/IP protocol traffic within a network based on the different traffic flows between between network hosts. SoNSTAR raises situational awareness levels for computer network defence by allowing operators to achieve better understanding and performance while imposing less workload compared to visual techniques. SoNSTAR identifies the features of network traffic flows by inspecting the status flags of TCP/IP packet headers and mapping traffic events to recorded sounds to generate a soundscape representing the real-time status of the network traffic environment. Listening to the soundscape allows the administrator to recognise anomalous behaviour quickly and without having to continuously watch a computer screen.Comment: 17 pages, 7 figures plus supplemental material in Github repositor